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SUMMARY 


We  consider  the  problem  of  compressed  sensing  and  propose  new  deterministic  constructions  of 
compressive  sampling  matrices  based  on  finite-geometry  generalized  polygons.  For  the  noiseless 
measurements  case,  we  develop  a  novel  recovery  algorithm  for  strictly  sparse  signals  that  utilizes 
the  geometry  properties  of  generalized  polygons  and  exhibits  complexity  linear  in  the  sparsity 
value.  In  the  presence  of  measurement  noise,  recovery  of  the  generalized-polygon  sampled  signals 
can  be  carried  out  most  effectively  using  a  belief  propagation  algorithm.  Experimental  studies 
included  in  this  report  illustrate  our  theoretical  developments. 


1.0  INTRODUCTION 


1.1.  Report  development 

Compressed  sensing  (CS)  emerges  as  a  new  technology  for  the  acquisition  of  sparse  signals.  Most 
natural  signals  are  seen  to  be  sparse  with  respect  to  some  basis  or  dictionary  of  waveforms. 
Compressed  sensing  attempts  to  perform  direct  sub-Nyquist  sampling  of  such  signals  that  would 
still  allow  (near-)perfect  reconstruction  later  on  as  needed.  Specifically,  compressed  sensing  aims 
at  capturing  all  (most)  information  present  in  a  high-dimensional  sparse  signal  using  only  a 
relatively  small  number  of  linear  signal  projections.  The  CS  line  of  research,  therefore,  involves 
development  of  measurement  matrices  with  good  compression  ratio  coupled  with  effective 
recovery  algorithms  of  low  computation  complexity. 

Candes  and  Tao  [1],  and  Donoho  [2]  demonstrated  that  a  sparse  signal  can  be  recovered  from 

n 

Oik  log( — ))  random  linear  measurements  with  high  probability  under  certain  plurality  and  energy 
k 

preserving  conditions  on  the  random  measurement  matrix  by  solving  an  /,  -norm  minimization 

linear  programming  problem  of  complexity  0(n  ),  where  k,  n  denote  the  sparsity  (number  of 
non-zero  elements)  and  dimensionality  of  the  original  signal,  respectively.  As  the  dimensionality  n 
grows,  0(n 3)  linear  programming  for  £,  -minimization  becomes  quickly  impractical  for 

implementation.  An  alternative  iterative  greedy  algorithm  of  complexity  0(nk2)  termed 
Orthogonal  Matching  Pursuit  (OMP)  was  suggested  in  [3].  A  modified  version  of  OMP,  called 
Stage-wise  Orthogonal  Matching  Pursuit  (StOMP),  identifies  multiple  non-zero  components  at 
each  stage  compared  to  only  one  in  OMP  and  results  in  the  improved  complexity  of  0(n  log n). 

The  work  mentioned  above,  so  far,  is  based  on  random  measurement  matrices  where  recovery 
can  fail  with  non-zero  probability.  For  hardware  implementation  and  critical  field  applications,  it  is 
highly  desirable  to  deploy  an  explicit  well-analyzed  and  understood  measurement  matrix  for 
compressed  sensing.  In  [5],  deterministic  measurement  matrices  are  reported  for  strictly  sparse 

signals  with  k  =  0(\fm)  where  m  is  the  number  of  measurements.  A  matrix  with  0(k\ og2 
« (measurement  rows  in  conjunction  with  a  recovery  algorithm  of  complexity  0(klog2n)  is 
developed  in  [6].  In  [7],  adjacency  matrices  from  expander  graphs  are  used  as  measurement 
matrices  with  a  recovery  algorithm  of  complexity  linear  in  n.  Criteria  to  use  the  suitability  of 
deterministic  measurement  matrices  to  operate  on  most  A-sparse  signals  are  provided  in  [8]. 

In  this  work,  we  construct  new  deterministic  sparse  measurement  matrices  in  {0,  1  \m/"  for 
compressed  sensing  from  classical  finite-geometry  generalized  polygons  [9],  [10],  [11],  [12],  For 
noiseless  sensing,  we  develop  a  novel  algorithm  that  iteratively  recovers  the  original  A-sparse 
signal  in  k  iterations  by  exploiting  the  property  that  the  generalized-polygon  measured  vector 
involves  only  structured  sums  of  subsets  of  the  elements  of  the  original  signal.  The  proposed 
algorithm  is  applicable  to  strictly  A-sparse  input  signals.  Extensions  to  the  case  where  the  input 
signals  are  less  than  A-sparse  and/or  are  sampled  in  the  presence  of  noise  are  also  considered. 
Motivated  by  the  success  of  decoding  generalized-polygon  low-density  parity-check  (LDPC) 
codes,  we  exploit  the  iterative  belief  propagation  (BP)  algorithm  as  the  means  to  efficiently  recover 
the  original  signals  from  compressed  measurements,  thus  deviating  for  both  noiseless  and  noisy 
sampling  from  conventional  I,  -norm  recovery  procedures. 
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2.0  METHODS,  ASSUMPTIONS,  PROCEDURES,  RESULTS  AND 

DISCUSSION 


2.1.  Compressed  sensing  background  and  problem  statement 

We  consider  a  family  of  signals  xGRn  that  are  /c- sparse  if  all  but  k  elements  of  x  are  zero.  The 
sparse  signals  can  also  be  extended  to  the  set  of  signals  that  have  a  sparse  representation  in  some 
particular  basis.  For  simplicity  of  our  presentation,  we  assume  that  all  sparse  signals  are 
represented  in  a  standard  basis  (the  n*n  identity  matrix).  In  compressed  sensing,  it  is  unnecessary 
to  measure  all  the  n  elements  of  the  signal  x;  instead,  we  only  need  to  measure  a  small  number  of 
linear  combinations  of  elements  of  x,  i.e. 


y  =  Ax,  (i) 

where  A  denotes  an  mxn  linear  measurement  matrix  with  m  «  n  and  x  is  a  A'-sparse  signal  in  Rn, 
k<m.  Most  existing  work  is  focusing  on  probabilistic  constructions  where  entries  of  A  are  drawn 
from  independent  and  identically  distributed  (i.i.d.)  Gaussian  or  Bernoulli  random  variables.  With 
these  measurement  matrices,  it  is  shown  [1]  that  given  the  number  of  measurements 

fl 

m  =  0{k  log(— )) ,  the  k- sparse  signal  x  can  be  exactly  recovered  via  £,  optimization 
k 


x  =  arg  min  ||x||fl  subject  to  y  =  Ax 


(2) 


with  overwhelming  probability.  Nevertheless,  when  the  dimensionality  n  is  large,  this  scheme  has 
two  significant  drawbacks:  (i)  Random  measurement  matrices  require  large  storage  space;  (ii)  the 
Ij  minimization  exhibits  complexity  0(n3)  which  is  too  high  for  implementation.  It  is  highly 

desirable  to  develop  deterministic  constructions  with  low  storage  requirements  and  low  complexity 
recovery.  In  the  following  section,  we  present  novel  deterministic  sparse  measurement 
matrices  associated  with  efficient  recovery  algorithms  for  compressed  sensing. 

2.2.  GP-based  measurement  matrices  and  recovery  algorithms 

2.2.1.  Measurement  matrices  based  on  generalized  polygons 

A  finite-geometry  generalized  polygon  is  referred  to  as  an  incidence  structure  T  =  (£|3,£,3) 
including  the  point  set  ¥ ,  the  line  set  £ ,  and  the  incidence  set  3  i  '£  x  £.  A  point  P  £  V  is 

incident  to  a  line  l  €  £,  say  p3/,  if  and  only  if  (p,  0  £  J.  Thus,  the  existence  of  incidence 
between  points  and  lines  can  be  represented  by  undirected  bipartite  graph  G,  as  illustrated  in  Fig.  1 . 
We  say  that  T  is  a  weak  generalized  polygon  if  and  only  if  the  diameter  of  G  is  half  of  its  girth.  T  is 
a  generalized  polygon  if  and  only  if  it  is  a  weak  generalized  polygon  and  each  vertex  of  G  has 
degree  at  least  three.  If  all  point  vertices  have  the  same  degree  t  +  1  and  all  line  vertices  have  the 
same  degree  5+1,  then  G  is  regular  and  T  has  order  (5,  t).  The  incidence  matrix  of  T  is  the  matrix 
with  rows  labeled  by  the  lines  of  T,  columns  labeled  by  the  points  of  T,  and  entries  1  or  0  depending 
on  the  corresponding  point-to-line  incidence.  It  is  straightforward  to  use  the  incidence  matrix  for  a 
given  generalized  polygon  T  as  the  measurement  matrix  for  compressed 
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d  line  set 


vp  point  set 

Figure  1 :  Bipartite  graph  representation  of  a  generalized  polygon  T. 

sensing.  Among  all  known  generalized  polygons  [12],  two  families  of  generalized  polygons, 
hermitian  generalized  quadrangles  H{ 3,  q2)  and  twisted  triality  hexagon  T  (q3,  q),  lead  to  the 
measurement  matrix  with  an  excellent  compression  ratio.  In  detail,  the  measurement  matrix  from 
H{ 3,  q  )  is  of  size  (q  +  Y)(q  +  1)  x  (q  +  l)(g  +  1)  corresponding  to  a  compression  ratio  (g+l)  :  (q 
+1)  while  the  one  from  T  ( q3,q )  is  of  size  (qH+q4+l)(q  + 1) x (qH+q4+ 1  )(q3+ 1 )  corresponding  to  a 
compression  ratio  (q+Y)  :  (q3+  and  q  E  TL.  On  the  other  hand,  the  storage  requirement  is 

also  a  key  concern  for  compressed  sensing  construction.  The  incidence  structure  for  7/(3,  q2)  and  T 
(q  ,  q)  has  order  (q  ,  q)  and  (q  ,  q),  respectively.  Thus,  the  measurement  matrix  from  H{ 3,  q  )  and  7 
(q3,  q)  requires  lower  storage  ( 0(q 6)  and  0(q]1),  respectively)  than  the  storage  requirements  of 
random  measurement  matrices,  ( 0(q 9)  and  0(q2°),  correspondingly). 


2.2.2.  Recovery  algorithm  for  the  noiseless  case 


We  collect  compressed  sensing  observations  from  a  GP-based  measurement  matrix  A  in  the 
noiseless  environment,  i.e. 

y  =  Ax,  (3) 

where  the  entries  of  A  are  restricted  to  {0,  1}.  The  measurements  are  seen  to  be  sums  of  small 
subsets  of  the  coordinates  of  x.  Let  S  G  supp(x)  be  the  support  set  of  x,  which  is  defined  as  the  set 
of  indices  corresponding  to  the  non-zero  coordinates  of  x.  We  assume  that  for  any  two  subsets  of  S, 
Si,  S2  ^  S  with  S)  ^  S2,  the  following  condition  holds: 


S Xi  ^  5Z x*- 


The  measurement  matrix  A  based  on  the  geometry  structure  of  generalized  polygons  has  the 
following  properties.  The  proofs  of  Propositions  2  and  3  are  given  in  Section  2.4. 

Proposition  1  For  any  two  rows  (columns)  of  A,  there  exists  at  most  one  column  (row)  with 
non-zero  entries  in  common. 
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Iterative  recovery  algorithm 
Initialize  =  0  and  y(0)  =  y. 

For  t  = 

(i)  Identify  the  index  c  such  that  at  least  two  of  the  measurements  corresponding  to 
supp(zLc)  take  a  non-zero  identical  value,  say  <L 

(ii)  Update  =  x^_1)  -J-  dec  and  yW  =  y(*_1)  —  dac. 

End 

Output:  Recovery  signal  x^f 

Figure  2:  Proposed  iterative  recovery  algorithm  in  the  noiseless  environment. 


Proof :  Rows  and  columns  stand  for  lines  and  points  in  generalized  polygons,  respectively.  Any 
two  different  lines  have  at  most  one  intersection  point  while  any  two  different  points  determine  one 
line. 


Proposition  2  Given  1  <u  <  2q  —  1,  the  submatrix  A (u)  that  consists  of  any  u  columns  of  the 
matrix  A  generated  from  H(3 ,  q)  has  at  least  two  rows  of  weight  1  located  in  the  same  column. 


Proposition  3  Given  1  <u  <3q  -  2,  the  submatrix  A  (u)  that  consists  of  of  any  u  columns  of  the 
matrix  A  generated  from  T  (q  ,  q)  has  at  least  two  rows  of  weight  1  located  in  the  same  column. 


We  are  now  ready  to  proceed  by  an  iterative  recovery  algorithm.  We  first  initialize  at  x(0)  =  0 
and  y<0)  =  y  where  superscripts  denote  iteration  index.  Let  a;  denote  the  z'-th  column  of  the 
measurement  matrix  A.  At  the  first  iteration,  Proposition  2  (or  Proposition  3)  implies  that  under  the 
assumption  in  (4)  and  the  condition  k<2q-\{or2>q-  2)  for  A  generated  from  H( 3,  q2)  (or  T  (q3, 
q)),  respectively,  we  can  identify  the  index  c,  1  <  c  <  n,  such  that  the  measurements  of  y(0) 
corresponding  to  supp(ac)  have  at  least  two  of  them  taking  a  non-zero  identical  value,  say  d.  We 
determine  the  c-th  element  of  x,  and  compute  the  estimate  update  by  x(1)  =  x(0)  +  dec ,  where  ec 
denotes  the  unit-length  vector  in  Rn  whose  elements  are  all  zero  except  for  the  c-th  element 
which  is  equal  to  one.  Furthermore,  we  also  update  the  measurement  vector  byy(1)  =y<0)  —dac. 

Thus,  the  sparsity  is  decreasing  to  k  -  1 .  It  is  clear  that  Propositions  2  and  3  still  hold  with  the 
sparsity  <k~  1 .  Repeating  the  procedure  k -  1  times/iterations,  we  can  finally  obtain  the  estimate 
x(/°  that  is  an  exact  recovery  of  x.  The  iterative  algorithm  is  summarized  in  Fig.  2.  We  note  that  the 
above  procedure  terminates  after  k  iterations,  and  each  iteration  requires  only  two  vector  updates. 
The  overall  complexity  of  this  algorithm  is  0(k). 
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2.2.3.  Recovery  algorithm  for  the  noisy  case 

The  recovery  algorithm  above  is  confined  to  the  noiseless  case  for  the  strictly  sparse  input  signal. 
In  fact,  most  compressed  sensing  systems  deal  with  moderately  sparse  input  signals  in  presence  of 
noise.  Motivated  by  LDPC  decoding,  we  exploit  a  belief  propagation  algorithm  for  compressed 
sensing  recovery.  A  BP  algorithm  [13]  can  efficiently  compute  the  marginal  posterior  distribution 
of  all  variables  conditioned  on  the  observations  by  iteratively  exchanging  messages  over  the  edges 
of  the  bipartite  graph.  First,  we  express  the  compressed  sensing  measurements  corrupted  by  noise 
as 

y  =  Ax  +  n,  (5) 

where  n  denotes  a  zero-mean  additive  white  Gaussian  noise  (AWGN)  with  covariance  matrix  a2I. 
To  ensure  signal  sparseness,  we  impose  a  two-state  mixture  prior  on  x.  Let  the  /-th  element 

k. 

of  x  be  Xj  =  BiGi,  where  the  state  variable  Bt  is  Bernoulli  with  Pr{Bi  =  1}  =  -  and 

Pr{Bi  =  0}  =  — -,  and  G,  is  Gaussian  with  mean  zero  and  large  variance  a2s  .  At  the  state 

B,  =  1,  the  element  x,  takes  a  non-zero  large  value  drawn  from  the  large-variance  Gaussian 
distribution.  On  the  other  hand,  x,  is  set  to  0  for  the  state  Bt  =  0.  The  overall  pdf  /  (x,)  of  this 
distribution  is  illustrated  in  Fig.  3.  Moreover,  it  is  assumed  that  the  coordinates  xj,  x?,  .  .  . ,  xn  are 
mutually  independent.  The  two-state  mixture  model  makes  the  signal  x  ^-sparse  as  n  is  large. 


We  consider  the  bipartite  graph  representation  of  A  in  Fig.  1.  In  the  graph,  the  message  along  the 
edge  is  defined  as  the  pdf  of  marginal  distribution  of  the  point  variable  associated  with  the  edge. 
Let  denote  the  message  sent  from  the  point  node  p  to  the  line  node  l  at  t- th  iteration,  and  let 

denote  the  message  coming  out  of  the  line  node  l  to  the  point  node  p  at  t-  th  iteration.  The  BP 
algorithm  starts  with  messages  M(p\,  from  point  to  line  nodes  (/'  (x, )).  In  each  iteration  of  BP, 

messages  first  propagate  over  the  edges  from  line  nodes  to  point  nodes.  Subsequently,  each  point 
node  generates  the  messages  based  on  the  previously  received  messages,  and  sends  them  back  to 
the  line  nodes.  The  messages  from  point  nodes  are  used  to  compute  the  new  messages  for  the  next 
iteration.  The  message  computation  is  conforming  to  the  following  rules  [14]: 

(i)  The  message  is  the  product  of  all  the  messages  received  at  p  except  the  one  coming 


Figure  3:  The  overall  pdf /  (x;)  of  a  two-state  mixture  distribution. 


5 


out  of  /,  i.e. 


M^(xp)  *  []  M^](xp),  (6) 

geN(p)-{l} 

a/(0  =crr 

where  the  operator  “oc”  means  that  '  p-*i  i  J-gev(p)-p}  -  9  p  for  some  constant  c  such 
that  is  a  probability  function,  and  Mp)  -  {/}  is  the  set  of  neighbors  of  p  excluding  /. 

(ii)  The  message  Mj^lp  s  updated  by  the  convolution  for  all  neighbors  of  l  except  p,  i.e. 

m£p(xp)  x  f  p(yi\x)  M^li(x'g)d{^{p}),  (7) 

J~{P)  geN(l)-{p} 

where  ~{p}  is  the  set  of  neighbors  of  /  excluding  p,  and  p(y;|x)  is  the  conditional  probability 
density  function  of  y;  given  x. 

After  several  iterations,  the  marginal  pdf  for  a  random  variable  xp  is  estimated  by  the  product  of  all 
most  recent  incoming  messages  along  the  edges  connecting  to  that  node: 


f(xp)  x  Mi_Jp(xp). 

leN(p)  '  ' 

Based  on  the  marginal  distribution,  we  can  extract  MAP  estimates  for  elements  of  x.  If  the  bipartite 
graph  is  free  of  cycles,  the  BP  algorithm  provides  an  exact  marginal  posterior  distribution. 
However,  for  the  GP-based  graphs  with  few  loops,  it  only  offers  an  approximate  inference  [15], 


2.3.  Simulation  studies 

In  this  section,  we  investigate  the  performance  of  compressed  sensing  systems  with  GP-based 
measurement  matrices  and  their  recovery  algorithms.  We  consider  the  sparse  input  signal  x  with 
sparsity  k.  The  positions  of  k  non-zero  coordinates  in  x  are  picked  uniformly  at  random 
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Figure  4:  Original  signal  x  and  recovered  signal  x  using  the  iterative  recovery  algorithm  in 
Section  2.2.2.  in  the  noiseless  environment. 
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Figure  5:  Normalized  MSE  as  a  function  of  the  sparsity  k  using  the  measurement  matrix  A  from 
H( 3,  q2)  and  BP  recovery  algorithm. 


and  their  values  are  drawn  from  the  Gaussian  distribution  with  mean  ju  =  0  and  standard  deviation 
os  =  10.  In  the  first  example,  we  are  dealing  with  compressed  sensing  in  the  noiseless  environment. 
The  measurement  matrix  A  is  generated  from  the  generalized  quadrangle  H{ 3,  32)  with  m  =  112 
and  n  =  280  as  described  in  Section  2.2.1.,  and  the  sparsity  k  of  x  is  set  to  be  5.  From  Fig.  4,  we 
observe  that  the  iterative  algorithm  in  Section  2.2.2  performs  an  exact  recovery  when  the  input 
signal  x  is  strictly  sparse. 


In  the  next  study,  we  compare  our  scheme  of  the  GP -based  measurement  matrix  and  the  BP 
recovery  algorithm  with  the  conventional  scheme  of  random  Bernoulli  measurement  matrix 
associated  with  the  LASSO  algorithm  [16]  in  the  noisy  environment.  We  still  use  the  incidence 
matrix  of  7/(3,  32)  as  the  measurement  matrix  A  and  the  same  signal  x.  The  maximum  iteration 
number  of  the  BP  algorithm  is  set  equal  to  10.  The  total  1000  experiments  are  carried  out  in  the 
presence  of  noise  that  is  taken  to  be  Gaussian  with  mean  0  and  covariance  matrix  I.  In  Fig.  5,  we 
plot  as  a  function  of  the  sparsity  k  the  normalized  mean-square-error  (MSE)  that  is  defined  as 

IE  II2 

normalized  MSE  =  E {- - JL} .  (9) 

llxll 


For  effective  visualization,  we  use  a  log  scale  for  the  v-axis.  We  observe  that  both  schemes 
perform  similarly  when  the  sparsity  k  varies  from  10  to  21.  The  conventional  scheme  performs 
slightly  better  than  the  proposed  scheme  after  k  =  21.  However,  the  LASSO  algorithm  exhibits  the 
complexity  of  convex  programming,  O (n3).  In  the  contrast,  the  overall  complexity  of  the  BP 

2  ||x-x|| 

algorithm  is  0(n  log  n)  [17].  In  Fig.  6,  we  take  the  average  normalized  £1  -error,  i.e.  E{-  — }  , 

Fill 

as  a  performance  metric.  We  observe  that  the  proposed  scheme  compares  favorably  to  the 
conventional  scheme. 
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Figure  6:  Average  normalized  f  t  -error  as  a  function  of  the  sparsity  fusing  the  measurement  matrix 
A  from  H( 3,  q2)  and  BP  recovery  algorithm. 

2.4.  Proof  of  propositions 

Proof  of  Proposition  2 

For  w  =  1,  it  is  straightforward  to  find  two  rows  of  Mu)  that  have  weight  1  in  the  same  column.  In 
the  following,  we  are  focusing  on  2  <  u  <  2q  -  1.  First,  the  submatrix  A (u)  falls  into  one  of  two 
cases. 

Case  1 :  There  exists  no  row  of  weight  2  or  more  in  A (u).  Of  course,  A (u)  has  at  least  two  rows  of 
weight  1  in  the  same  column. 

Case  2:  There  exists  at  least  one  row  of  weight  2  or  more  in  A (u).  Proposition  1  implies  that  two 
columns  of  A (zz),  say,  the  z-th  and  /-th  columns,  have  the  property  that  the  intersection  set  of 
suppfa,)  and  supp(ay)  contains  only  one  element,  say  r,  1  <r  <m.  Because  each  of  a;  and  a ij  has 
q  + 1  non-zero  entries  and  only  the  r-th  row  of  A  (u)  has  two  l’s  at  the  z-th  and  /-th  coordinates,  a 
total  of  2 q  +  1  rows  of  A(u)  are  incident  to  two  columns  a,  and  a7 .  Let  A (u,  i,  j )  be  the  submatrix 
formed  by  the  2q  +  1  rows  of  Mu).  Without  loss  of  generality,  let  av  be  one  column  of  Mu) 
different  than  a,  and  a y  The  columns  a, ,  a /  and  av  correspond  to  the  points  pt  ,pj  and ps,  respectively 
If  the  point  ps  is  incident  to  the  line  lr  which  both  points  pt  and  pj  are  incident  to,  then  the  column  of 
the  matrix  A(zz,  i,  j )  corresponding  to  ps  has  only  one  nonzero  entry  by  Proposition  1 .  Otherwise,  ps 
is  collinear  with  either  of  pt  and  pj  or  none  of  them  by  the  following  lemma  [18]. 

Lemma  1  For  every  non-incident  pair  (p,  l)  of  a  generalized  quadrangle,  there  exists  a  unique  pair 
( p',11 ’)  g  'P  x  ~  ,for  which  P  -1  ^  -1  p'  -1  ^ . 

This  implies  that  there  exists  at  most  one  nonzero  entry  on  each  column  of  Mu,  i,  j )  except  for  the 
two  columns  corresponding  to  p,  and  pj. 

Now,  we  count  the  total  number  of  nonzero  entries  in  A(zz,  z,  j)  which  is  at  most  2(c/+  l  )+t/-2. 
Suppose  that  v  is  the  number  of  rows  in  A (u,  i,  j )  with  weight  1 .  Then,  2q  +  1  -  v  row  has  at  least 
weight  2.  We  can  obtain  the  inequality 
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v  +  2(2 q  +  1  —  v)  <  2(q  +  1)  +  u  —  2. 


(10) 


For  2  <  u  <  2q  —  1,  the  inequality  (10)  leads  to 


v>2q  +  2~u>3. 


(11) 


At  least  two  indices  of  rows  with  weight  1  belong  to  either  supp(a;)  or  supp(a,)  which  completes 
the  proof. 

Proof  of  Proposition  3 

Proposition  3  can  be  proved  in  the  same  manner  as  Proposition  2.  The  case  of  u  =  1,  2  is 
straightforward  and  thus  omitted.  In  the  following,  we  focus  on  3  <  u  <  3q  -  2.  We  consider  three 
cases  for  A (u):  (i)  No  row  of  weight  2  or  more;  (ii)  only  one  row  of  weight  2  and  no  row  of  weight 
more  than  2;  (iii)  two  or  more  rows  of  weight  2  or  more.  For  the  first  two  cases,  it  is  easy  to  find 
two  rows  of  weight  1  in  the  same  column.  For  the  last  case,  we  select  three  different  columns  of 
A (u),  say  h- th,  z-th  and y'-th  columns  denoted  by  a*,  a,  and  a7,  having  the  following  property 


\supp(ah)  U  suppiai)  U  supp(aj)\  =  3 q  +  1. 


(12) 


Let  A (u,  h,  i,  j )  be  the  submatrix  formed  by  the  3q  +  1  rows  of  A (u).  The  points  pi,,  p„  pj  that 
correspond  to  a h  ,  a, ,  a;  exhibit  one  of  the  following  geometric  relations:  (1)  All  three  points  are 
incident  to  the  same  line;  (2)  pt ,  pj  are  collinear  with  p/,,  but  pf  is  not  collinear  with  pp  (3)  ph  is 
collinear  with  p, ,  p,  is  collinear  with  pj ,  and  pj  is  not  collinear  with  pn  by  the  following  lemma  in 
[18]. 

Lemma  2  For  every  non-incident  pair  (p,  l)  of  a  generalized  hexagon,  there  exists  a  unique  pair 
ip',  l')  e  for  which  P  3  V  J  p'  3  l  or  a  unique  quadruple 


For  all  three  scenarios,  Lemma  2  also  implies  that  there  exists  at  most  one  non-zero  entry  on  each 
column  of  A (u,  h,  i,  j )  except  the  three  columns  corresponding  to  pi„  p„  pj. 

We  count  the  total  number  of  nonzero  entries  in  A (u,  h,  i,  j )  which  is  at  most  3 (q + 1)  +  u  -  3. 
Suppose  that  v  is  the  number  of  rows  in  A (u,  h,  i,j )  with  weight  1 .  Then,  3q  +  1  -  v  row  has  at  least 
weight  2.  We  can  obtain  the  inequality 


v  +  2(3 q  +  1  —  v)  <  3  iq  +  1)  +  u  —  3. 


(13) 


For  3  <  u  <  3q  -  2,  the  inequality  (13)  leads  to 


v>3q  +  2~u>4. 


(14) 


This  implies  that  at  least  two  indices  of  rows  with  weight  1  belong  to  one  of  suppiaf),  supp{  a;)  and 
suppiaf 


9 


3.0  CONCLUDING  REMARKS 


In  this  work,  we  constructed  two  families  of  deterministic  sparse  measurement  matrices  generated 
from  finite-geometry  generalized  polygons,  H(3,  q2)  and  T  (q2,  q).  Exploiting  the  geometry  feature 
of  GPs,  we  develop  an  iterative  recovery  algorithm  that  achieves  perfect  recovery  for  strictly 
sparse  signals  in  the  noiseless  environment.  This  algorithm  is  highly  efficient  and  requires  linear 
computation  complexity  0{k).  We  also  considered  compressed  sensing  systems  with  moderately 
sparse  input  signals  in  the  presence  of  noise.  We  developed  a  belief  propagation  algorithm  for 
compressed  sensing  recovery  that  exhibits  nearly  linear  complexity  0{n  log2/?).  Simulation  studies 
illustrated  our  theoretical  developments. 
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ACRONYMS 


CS:  Compressed  sensing 

OMP:  Orthogonal  matching  pursuit 

StOMP:  Stage- wise  orthogonal  matching  pursuit 

LDPC:  Low-density  parity-check 

BP:  Belief  propagation 

GP:  Generalized  polygon 

AWGN:  Additive  white  Gaussian  noise 

MAP:  Maximum  a  posteriori 

MSE:  Mean  squared  error 
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